A Sparsity Promoting Adaptive Algorithm for Distributed Learning
نویسندگان
چکیده
منابع مشابه
A Sparsity-Aware Adaptive Algorithm for Distributed Learning
In this paper, a sparsity-aware adaptive algorithm for distributed learning in diffusion networks is developed. The algorithm follows the set-theoretic estimation rationale. At each time instance and at each node of the network, a closed convex set, known as property set, is constructed based on the received measurements; this defines the region in which the solution is searched for. In this pa...
متن کاملEfficient Distributed Learning with Sparsity
We propose a novel, efficient approach for distributed sparse learning with observations randomly partitioned across machines. In each round of the proposed method, worker machines compute the gradient of the loss on local data and the master machine solves a shifted `1 regularized loss minimization problem. After a number of communication rounds that scales only logarithmically with the number...
متن کاملAdaptive sparsity tradeoff for ℓ1-constraint NLMS algorithm
Embedding the l1 norm in gradient-based adaptive filtering is a popular solution for sparse plant estimation. Even though the foundations are well understood, the selection of the sparsity hyper-parameter still remains today matter of study. Supported on the modal analysis of the adaptive algorithm near steady state, this paper shows that the optimal sparsity tradeoff depends on filter length, ...
متن کاملSeismic data denoising through multiscale and sparsity-promoting dictionary learning
Seismic data comprise many traces that provide a spatiotemporal sampling of the reflected wavefield. However, such informationmay suffer from ambient and random noise during acquisition, which could possibly limit the use of seismic data in reservoir locating. Traditionally, fixed transforms are used to separate the noise from the data by exploiting their different characteristics in a transfor...
متن کاملSparsity priors and boosting for learning localized distributed feature representations
This technical report presents a study of methods for learning sparse codes and localized features from data. In the context of this study, we propose a new prior for generating sparse image codes with low-energy, localized features. The experiments show that with this prior, it is possible to encode the model with significantly fewer bits without affecting accuracy. The report also introduces ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Signal Processing
سال: 2012
ISSN: 1053-587X,1941-0476
DOI: 10.1109/tsp.2012.2204987